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Method of allocating optimal payload space 



Field of the invention 

The present invention relates to methods of allocating optimal payload space, 
and to an ^qparatus operable to implement the method. The invention also relates to software 
executable on computing devices to implement the method. 

5 

Background to the invention 

Producers of audiovisual programme content, for example television 
broadcasters or advertisers, are often interested in knowing where and when their programme 

10 content is distributed. In order to provide such knowledge, broadcast monitoring systems 
have been developed. In one monitoring system, a watermark is embedded in programme 
content The watermark is arranged to include a payload for pointing to a database entry 
corresponding to the progra3tnme content. In use, the watermark is retrieved and employed to 
identify the content A problem encountered with such an approach is that a relatively large 

IS payload is required when tiie database is extensive. The large payload is difficult to embed in 
programme content whilst being substantially imperceptible and imobtrusive. 

One known approach to address the above problem is described in a published 
international PCT patent application no. PCT/EPOl/07842 (WO 02/09328). In this published 
application, tiiere is disclosed a method and arrangement for distributing multimedia content 

20 such that actual distribution of the content can be monitored in an efficient and reliable 

manner. The method combines the effectiveness of feature extraction and the robustness of 
watermarking. The method concems extracting characteristic features such as luminance 
distribution from programme content to constitute a signature (SIG) of the content 
Moreover, the method concems embedding a watermark in the content, the watermark 

25 bearing a payload representing an index (ED) in a database in which the programme content 
to be monitored is stored. The watermark serves as an index for limiting database searching 
needed for monitoring the signatures. 

The inventors have ^appreciated that there is a certain maximum payload space 
available in watermarkmg system when watermarking programme content Moreover, the 
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inventors have envisaged that it is desirable to employ a method of watermarking which 
optimally utilizes this payload space. Furthermore, the inventors have ^predated that more 
efficient use of payload space by using the method of Ihe invention is enable of making 
available additional space for conveying enhanced features directed towards improving 
S security. 

In a specific proprietary development project with which the inventors have 
been involved, limited watermark payload capacity has been a particular problem. In this 
project, available watermark payload space in programme content is used to convey 
transaction information, in particular, content identification (CID) and user identification 
10 (UID) and an optional redundancy to improve security. The inventors have identified a 

problem that allocating a predefined space in tiie payload for each of these parameters results 
in very sparse usage of payload space, and sub-optimal use of redundancy within the payload. 



IS Object and sunmiary of the invention 

An object of the invention is to provide a method of allocating watermarking 
payload space more optimally. Therefore, the inventors have devised a solution which at 
least partially addresses the above-mentioned problem. 

According to a first aspect of the present invention, there is provided a method 
20 of allocating optimal payload space, the method including steps o£ 

(a) obtaining identification parameters relating to progranmie data content (PC), 
said identification parameters including at least one or more user identifiers (UID) and one or 
more programme content identifiers (CID); 

(b) storing said identification parameters (UID, CID) in one or more databases 
25 (30); 

(c) generating one or more transaction numbers (nTR) capable of being uniquely 
mapped to corresponding identification parameters (UID, CID) stored in the one or more 
databases (30); and 

(d) generating watermark information for carrying said one or more transaction 
30 numbers (nTR) and embedding said watermark information as an optimized payload (OPL) 

into said programme data content (PC) to genemte corresponding watermarked data content 
(WPC). 

The invention is of advantage in that it is cq)able of offloading data fix>m the 
payload to the one or more databases, thereby making more payload space available in Ihe 
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watermarked progtanune content for other payload data, for example security enhancing 
data. 

Fte&rably, the method fbrther comprises a step of supplying said watermarked 
programme content (WPC) to one or more users, wherein the one or more transaction 
5 numbers (nTR) are c£^able of bemg detected in the water marked programme content (WPC) 
when received by said one or more users for use in accessing corresponding identification 
parameters (UID, CID) stored in the one or more databases. Inclusion of the one or more 
transaction numbers in the payload is of benefit in that it circumvents a need to include the 
corresponding identification parameters within the payload, there by potentially fireeing 
1 0 payload capacity for other purposes. 

Preferably, in the method, fingerprint information (FP) of the programme 
content (PC) is stored in the one or more databases (30) together with its associated 
identification parameters (UID, CID). Such fingerprint information is capable of providing a 
general impression of the programme content and is therefore of benefit in further validating 
1 S authenticity of the programme content 

Preferably, in the method, verification of the identification parameters (lUD, 
CID, FP) with the watermarked programme content (WPQ atliie one or more users is 
implemented as an automatic process without the one or more users needing to intervene. 

Preferably, the method includes a ftirther step of identifying whether or not the 
20 watermarked programme content (WPC) has been legitimately received by the one or more 
users by checking whether the received watermarked programme content (WPC) has a 
payload (OPL) whose transaction nxmiber (nTR) invokes identification parameters stored in 
the one or more databases consistent with the received programme content (WPC). Such 
checking is of benefit in that it allows for the identification of non-legitimate programme 
25 content 

Preferably, in the method, the one or more transaction numbers (nTR) are 
included in the watermarked programme content (WPC) after being encrypted with an 
encryption key (Kpl). Use of such an encryption key (Kfl) is capable of rendering the 
watermark information more difficult to copy for re-use in watermaddng counterfeit or pirate 
30 programume content Thus, such encryption is capable of fiirther deterring counterfeiting and 
unauthorised programme content copying activities. 

Preferably, in the method, the identification parameters (UID, CID) stored in 
the one or more databases (30) are conmionly accessible to a supplier of the programme 
content (PC) and one or more of the users authorised to access said parameters (UID, CID). 
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Such an arrangement is of benefit in reducing information conveyed in the watermark 
information applied to the programme content whilst rendering the watermarked data content 
acceptable to a wider range of users. 

Preferably, in the method, the identification parameters are writable into the 
S one or more databases by a supplier of the programme contrat (PC) and the one or more 
users are restricted only to reading the identification parameters fix>m the one or more 
databases. Such accessibility to the one or more databases is capable of deterring pirating 
and counterfeiting activities by third parties. 

According to a second aspect of the invention, there is provided software 
10 executable on one or more computing devices for implementing the method of the first aspect 
of the invention. It will be appreciated that the method is also capable of being implemented 
substantially in hardware form, for example in the form of a dedicated application specific 
integrated circuit (ASIC). Such an implementation is of benefit in low-cost consumer 
products. 

15 According to third aspect of the present invention, there is provided an 

apparatus for allocating optimal payload space, the apparatus including: 
(a) data collecting means for obtaining identification parameters relating to 

programme data content (PC), said identification parameters including at least one or more 
user identifiers (DID) and one or more programme contmt identifiers (CID); 

20 (b) one or more databases for storing said identification parameters (UID, CID); 

(c) generating means for generating one or more transaction numbers (nTR) 
capable of being uniquely mapped to corresponding identification parameters (UID, CID) 
stored in the one or more databases; 

(d) data processing means for generating watermark information carrying said one 
25 or more transaction numbers (nTR), and processing means for embedding said watermark 

information as an optimized payload (OPL) into the progranomae content (PC) to generate 
corresponding watermarked programme content (WPC). 

According to a fourth aspect of the present invention, there is provided 
watermarked programme content (WPM) including a watermark whose payload space is 
30 allocated optimally according to a method of the first aspect of the invention. 

According to a fifth aspect of the invention, &ere is provided a watermark 
including a payload whose payload space is allocated optimally according to a method of the 
first aspect of the invention. 
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According to a sixth aspect of the present invention, there is provided a 
method of authenticating watemaaxked programme content (WPC) whose embedded 
watemiaxk information includes an optimised payload (OPL) including one or more 
transaction numbers (nTR) which are mapped, preferably uniquely mapped, to corresponding 
S identification parameters (UID, CID, FP) stored in one or more databases, the method 
including steps of: 

(a) receiAong the watermarked programme content (WPC) at one or more 
authorized users; 

(b) eTctracting watermark information from the received watermarked programme 
10 content (WPC); 

(c) determioing a payload (OPL) included in the watermark information, said 
payload including one or more transaction numb^ (nTR); 

(d) using said one or more transaction numbers (nTR) to access corresponding 
identification parameters from said one or more databases (30), said identificaticm parameters 

1 S (UID, CID, FP) including a program content fingetxnint (FP); 

(e) obtainingalocaUy extracted fingerprint (FPL) of said received watermarked 
program content (WPQ; 

(f) checkmg whether or not said locally extracted fingerprint (FPL) matches said 
program content fingerprint (FL) obtained fix>m said one or more databases to determine 

20 authenticity of the waterimacked programme content (WPC). 

It will be appreciated that features of the invention are susceptible to being 
combined in any combination without departing from the scope of the iovention. 



25 Description of the diagrams 

Embodiments of the invention will now be described, by way of example only, 
with reference to the following diagrams wherein: 

Fig. 1 is a schematic diagram of a payload generator according to the 
invention for generating watermark payloads whose space has been more optimally used to 
30 convey programme content authenticating data; 

Fig. 2 is a schematic diagram of an alternative payload generator according to 
the invention adapted to include fingerprint information in its watermark payloads; and 

Fig. 3 is an illustration of interaction between the generators of Figures 1 and 2 
and their associated programme content supplier and user. 



PHNL040090EPP 



6 16.01.2004 

Description of embodiments of the invention 

In devising an at least partial solution to sparse usage of payload space and 
5 sub-optimal use of redundancy, the inventors propose a method of allocating optimal payload 
space in a watennarkmg system in which a payload is included in a watermark, the payload 
being arranged to include a transaction number wherein the transaction number is susceptible 
to being mapped to actual corresponding transaction parameters such as UID and CID via a 
commonly accessible table, for example a table stored in a database and accessible to 

10 authorized users. The table is preferably capable of being written to by a watermark 

embedder and being read by a watermark detector. In the detector, the transaction number is 
initially extracted from the watermark and, by using a unique mapping associating the 
transaction number to its corresponding CCD and UID, the CID and UID are recovered from 
the table. By employing such a method, an amount of payload space used substantially is 

1 5 equal to the nGJnimimi numb^ of bits required to uniquely represent the transactions. 

In Fig. 1, there is shown an embodiment of the invention, wherein a payload 
generator is indicated generally by 10. The generator 10 is operable to receive CID and UID 
information and to generate a corresponding payload OPL, wherein OPL = FPL(nTE(, Kpl) 
namely an encrypted version of a transaction number (nTR) where FPL is representative of 

20 encryption appHed by an encryption function (ENC) 60 of the generator 10. A key Kpl is 
generated by a key generation function (KY) 20 arranged to receive the CID and 
subsequentiy output the key Kpl, namely Kpl=FKPL(CID). The irtD of the user desirous of 
the programme content corresponding to the CID is passed through a transaction counting 
function (TRC) 40 to generate the transaction number (nTR). Moreover, the CID together 

25 with its related UID and transaction number nTR are stored as a table in a database (dBT) 30 
of the generator 10; in other words, tables stored in the database 30 correspond to a set of 
parameters [nTR, UID, CID]. The generator 10 also includes a payload formatting function 
(PF) SO for receiving the transaction number nTR from the coimting function TRC 40 and 
generating a corresponding formatting parameter PL for use in the encryption functbn ENC 

30 60 when encrypting the transaction number nTR to generate the oulput payload OPL. 

The generator 10 in Figure 1 is susceptible to being modified to provide a 
modified generator indicated by 100 in Figure 2. The generator 100 includes a feature for 
receivmg fingerprinting data (FP) for storage in tables in the database dBT 30, such that a 
table in the database dBT 30 correspond to a set of parameters [nTR, UID, CED, FP]. 
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t 

The oulput payload OPL is enijedded in the fonn of watennark infonnatioii in 
programme content provided to the user corresponding to UID requesting content £rom a 
content provider having one or more of tiie generators 10, 100. In such a process, 
programme content provided to a user is uniquely marked so that user is susceptible to being 
5 uniquely identifies in an event of the user distributing the content is an unauthorised manner. 

The generator 10, or the generator 100, is usable in a edacity as illustrated in 
Fig. 3. In Fig. 3, the generator 10, 100 is coupled to a watermark embedder 200 for adding 
watermark content including an opthnized payload to programme, content distributed from a 
database 210 to a user 220. Such distribution occurs, for example, by way of a 

10 communication network such as the Internet; alternatively, the distribution can alternatively 
be achieved by way of physical data carrying media, for example magnetically and/or 
optically readable data carriers such as CD's and DVD's. Preferably, release of the 
programme content (PC) from the database 210 to the embedder 200 is executed in response 
to a request (RETPC) 230 from the user 220 for the programme content PC subsequenfly 

1 5 watermarked (WPC) through the embedder 200 qperating in combination with the generator 
10, 100, for example in return for payment as consideration for the programme contmt PC. 
Optionally, the database 210 and the database dBT 30 of the generator 10, 100 are the same 
entity. 

As an example of use of the generator 10, and similarly the generator 100, a 
20 situation arises where four people A-D buy sbcteen items PCI -PCI 6 of programme content as 
listed in Table 1: 



Table 1: 



Person 


Programme content 


A 


PCltoPC12 


B 


PC13 


C 


PC14-15 


D 


PC16 



25 A total number of transactions involved, using the generator 10, 100 in 

distributing such programme content, is 16 transactions; in other words, 4 bmary bits are 
required to define uniquely each transaction. If separate identifiers were used for the UID 
and CID, 2 binary bits would be required to represent uniquely the users and 4 binary bits to 
uniquely define the progranmie contents, namely a total of 6 binary bits would be required. 
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During detection at the user 220, a watermark detector thereat initially extracts 
a payload from the watermarked programme content WPC received thereat. The payload is 
then decrypted to provide a corresponding transaction number nTR for the programme 
content. The user 220 then communicates with the database dBT 30 to derive corresponding 
S UID and CID parameters. By such a process, user and content identities can be determined. 
Any disparity between the identity of the user 220, and the UID and CID on the database 
dBT 30 is indicative of the user 220 attempting to view copied, pirated or otherwise 
counterfeit programme content. If required, communication between the user 220 and the 
databases 30, 210 can be implemented substantially without the user 220 as a person being 

10 aware of such transaction occurring. 

As elucidated in the forgoing, the generator 100 allows for entry of fingerprint 
information FP into the payload OPL. Fingerprinting is susceptible to increasing security 
when watermarked programme content WPC is distributed to users. In an event that a user, 
for example a counterfeiter, transplants the payload OPL from one programme content to 

IS another, the fingerprint information can be used to verify whether or not a given item of 
programme content corresponds to originally distributed watennajdced programme content. 
Such verification involves extracting a transaction number nTR from programme content and 
then fingerprint FP iirformation; a check is then made to determine whether or not the 
extracted fingerprint matches with that stored in the database dBT 30. If the payload is 

20 copied firom one programme content to another, the extracted fingerprinting^ FP will not 
match that stored on the database dBT 30 for that particular jnrogramme content PC. 

On account of inclusion of the fingerprint FP information, the invention also 
concerns a method of authenticating watermarked programme content WPC whose 
embedded watermark information includes an optimised payload OPL including one or more 

25 transaction numbers nTR. The transaction parameter are mapped, preferably uniquely 
mapped, to corresponding identification parameters UID, CID, FP stored in one or more 
databases. In the authentication method, the watermarked programme content WPC is 
received at one or more authorized users. Next, the one or more users extract watermark 
information from the received watermarked programme content WPC and subsequentiy 

30 determine a payload OPL included in tibe watermark information. The payload includes one 
or more transaction numbers nTR. The one or more transaction numbers nTR are then 
useable to access corresponding identification parameters fix>m the one or more databases; 
the identification parameters UID, CID, FP including a program content fingerprint (FP). 
Next, tiie one or more users determine a locally extracted fingerprint (FPL) of the received 



PHNL040090EPP 

9 16.01.2004 
watermarked prbgram content WPC. Subsequently, the one or more users check whether or 
not the locally extracted fingerprint FPL matches the said program content fingerprint FP 
obtained fiom the said one or more databases. If the two fingerprints FPL, FP substantially 
match, the watermarked programme content WPC is confirmed to be authentic. Conversely, 
S when there is a substantial difference between Hie fingerprints FP, FPL, the watermarked 
programme content WPC is thereby identified as being copied and/or counterfeit 

It will be appreciated that embodiments of the invention described in the 
foregoing are susceptible to being modified without departing from the scope of the invention 
as defined by the accompanjdng claims. 

10 Expressions such as "comprise", "include", "incorporate", "contain", "is" and 

"have" are to be construed in a non-exclusive manner when interpreting the description and 
its associated claims, namely constmed to allow for other items or components which are not 
explicitly defined also to be present. Reference to the singular is also to be constmed in be a 
reference to the plural and vice versa. 

1 S The invention can be summarized as follows. In Electronic (Music) Delivery 

systems, a watermark payload should convey data such as Content ID and TJs&c ID. However, 
allocating a predefined space for each of these parameters is suboptimal and requires a large 
number of bits. To this end, it is proposed to embed a ^^ansaction number" and use a 
database (writable to embedder, readable to detector) to provide for the mapping between this 

20 transaction number and the actual parameters. For example: if 4 persons buy 16 contents, 
there are 16 transactions which can be represented by in a 4bit transaction nimiber, whereas 
individual encoding would require 2 bits to identify the user and 4 bits to identify the content 
(total 6 bits). In a preferred embodiment, the table also has an entry for fingerprints. This 
provides additional security in case a malicious user would succeed in transplanting the 

25 payload from one content to another. In this system, the detector extracts the fingerprint firom 
the contents and verifies whether the extracted fingerprint matches or not the one stored in 
the database. 
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CLAIMS: 



1 . A method of allocating payload space, the method including steps of: 

(a) obtaining identification parameters relating to programme data content (PC), 

said identification parameters including at least one or more user identifiers (UID) and one or 
more programme content identifiers (CID); 
5 (b) storing said identification parameters (UID, CID) in one or more databases 

(30); 

(c) generating one or more transaction nimibers (nTR) enable of being uniquely 

mapped to corresponding identification parameters (UID, CID) stored in the one or more 
databases (30); and 

10 (d) generating watermark information for carrying said one or more transaction 

nxmibers (nTR) and embedding said watermark information as an optimized payload (OPL) 
into said programme data content (PC) to generate corresponding watermarked data content 
(WPC). 

15 2. A method according to Claim 1 , fbrfher comprising a step of suppl3dng said 

watermarked programme content (WPC) to one or more users (220), wherein the one or more 
transaction nmnbers (nTR) are enable of being detected in the water marked programme 
content (WPC) when received by said one or more users (220) for use in accessing 
corresponding identification parameters (UID, CID) stored in the one or more databases (30). 

20 

3. A method according to Claim 1, wherein fingerprint information (FP) of the 

programme content (PC) is stored in the one or more databases (30) together with its 
associated identification parameters (UID, CID). 

25 4. A method according to Claim 1, wherein verification of the identification 

parameters (lUD, CED, FP) with the watermarked programme content (WPC) at the one or 
more users (220) is implemented as an automatic process without the one or more users (220) 
needing to intervene. 
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5. 



A method according to Claim 1 , mcluding a further step of identifying whether 



or not the watermarked programme content (WPC) has been legitimately received by the one 
or more users (220) by checking whether llie received watermarked programme content 
(WPC) has a payload (OPL) whose transaction number (nTR) invokes identification 
S parameters stored in the one or more databases (30) consistent with the received programme 
content (WPC), 

6. A method according to Claim 1, wherein the one or more transaction numbers 
(nTR) are included in the watermarked programme content (WPC) after being encrypted with 

10 an encryption key (Kpl)- 

7. A method according to Claim 1, wherein the identification parameters (UID, 
CID) stored in the one or more databases (30) are commonly accessible to a supplier of the 
progranmie content (PC) and one or more of the users (220) authorised to access said 

15 parameters (UID, CED). 

8. A method according to Claim 1, wherein the identification parameters are 
writable into the one or more databases (30) by a siqyplier of the programme content (PC) and 
the one or more users (220) are restricted only to reading the identification parameters fixnn 

20 the one or more databases (30). 

9. Watermarked programme content (WPM) including a watermark whose 
payload space is allocated optimally according to a method of Claim 1. 

25 1 0. A watermark including a payload whose payload space is allocated optimally 

according to a method of Claim 1. 

1 1 . Software executable on one or more computing devices for implementing the 



method of Claim 1. 



30 



12. 



An apparatus (10, 100) for allocating payload space, the apparatus (10, 100) 



including: 
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(a) data collecting means for obtaining identification patameters relating to 
programme data content (PC), said identification parameters including at least one or more 
user identifiers (UTO) and one or more programme content identifiers (CID); 

(b) one or more databases (30) for storing said identification parameters (UID, 
5 CID); 

(c) generating means for generating one or more transaction numbers (nTR) 
capable of being uniquely mapped to corresponding identification parameters GJID, CID) 
stored in the one or more databases (30); 

(d) data processing means for generating watermark information carrying said one 
10 or more transaction numbers (nTR), and processing means for embedding said watermark 

information as an optimized payload (OPL) into the programme content (PC) to gCTierate 
corresponding watermarked programme content (WPC). 

13. A method of authenticating watermarked programme content (WPQ whose 

1 5 embedded watermark information includes an cptimised payload (OPL) including one or 
more transaction numbers (nTR) which are mapped; preferably uniquely m^)ped, to 
corresponding identification parameters (UID, CID, FP) stored in one or more databases, the 
method including steps of: 

(a) receiving the watermarked programme content (WPC) at one or more 
20 authorized users; 

(b) extracting watermark information firom the received watermarked programme 
content (WPC); 

(c) determining a payload (OPL) included in the watermark information, said 
payload including one or more transaction numbers (nTR); 

25 (d) using said one or more transaction numbers (nTR) to access corresponding 

identification parameters fiom said one or more databases (30), said identification parameters 
(UID, CID, FP) including a program content fingerprint (FP); 

(e) obtaining a locally extracted fingerprint (FPL) of said received watermarked 
program content (WPC); 

30 (f) checking whether or not said locally extracted fingerprint (FPL) matohes said 

program content fingerprint (PL) obtained from said one or more databases (30) to determine 
authenticily of the watermarked programme content (WPC). 
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ABSTRACT: 



There is provided a method of allocating optimal payload sfpace in a 
watermarking system. The method includes steps of: 

(a) obtaining identification parameters relating to programme data content (PC), 
said identification parameters including at least one or more user identifiers (UID) and one or 

5 more programme content identifiers (ODD); 

(b) storing said identification parameters (UID, CID) in one or more databases 
(30); 

(c) generating one or more transaction numbers (nTR) capable of being uniquely 
m^yped to corresponding identification parameters (UID, CID) stored in the one or more 

10 databases (30); and 

(d) generating watermark information for carrying said one or more transaction 
numbers (nTR) and embedding said watermark information as an optimized payload (OPL) 
into said programme data content (PC) to generate corresponding watermarked data content 
(WPC). 

15 
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